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I Process for detecting surface detects in a substantially plane textured 
surface, 

wherein it comprises the following steps of 

a) making, with the aid of an optical sensor presenting an inclination of 
sight with respect to the substantially plane textured surface and being in relative 
movement w ith respect to this surface, a succession of images of pans of this 
surface at successive instants, each image corresponding to a surface part of 
length L in the direction of displacement, each image being offset from the 
preceding one by a length I I being equal to L K with K, a whole, greater than 2. 

b) defining sub-images corresponding to elementary portions of the surface 
w hose length is equal to I in the direction of displacement, w hereby for the length 
of portion of surface K K sub-images of this portion are available. 

c) extracting from these K consecutive sub-images N sub-images < Ii ) 
corresponding to the same portion of the surface of length I at N successive 
instants with N included between 2 and K: 

d) applying to each of the N su, -images < In the same spatial mathematical 
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processmg in order possibly to demonstrate a configuration of presumed detect 

winch gives a processed mtennediate sub-image < Yi). 

e) applying to the first processed elementary sub-image ( Vol a 
combinatorial algorithm for detection of presumed defect in the elementary sub- 
image, whereby a spatial and temporal sub-image ST, is obtained. 

0 iteratively repeating the application of said combinatorial algorithm to 
the spatial and temporal sub-image ST,.| obtained at instant ti-l and to the 
processed elementary sub-image Yi in order to obtain a spatial and temporal sub- 
image ST, up to i - N - I ; and 

g) obtaining with the spatial and temporal sub-image ST N .i the image of the 
elementary portion of the textured surface w ith its possible defects 

2. The process of Claim I . wherein, before step d). there is applied to each 
sub-image a processing for at least partial correction of the effects of perspective 
due to the inclination of the optical sensor w ith respect to the textured surface 

3. The process of Claim 2, w herein said spatial mathematical process of step 
d) consists in applying to said elementary image a markovian model with regular 
or irregular grid. 
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FIELD OF THE IN VENTK >N 
The present invention relates to a process for detecting surface defects in a 
substantial!; plane textured surface. In the case of a substantially plane textured 
surface, the detection of defects raises particular problems, due to the 
interference, at the optical level, between the texture of the surface and the 
defects that said surface may present. This is particularly but not exclusively the 
case of the detection of defects on a highway. 

BACKGROUND OF THE INVENTION 
When it is desired to check the quality of a highway surfacing, the state of 
a section of highway can be inspected directly by the human eye. Such an 
inspect. Jn furnishes a very detailed analysis of the degradations of the surfacin« 
However, it will be understood that such a technique is extremely long and 
therefore extremely expensive to carry out. It is for this reason that it has been 
sought to develop techniques for automatically detecting such defects. 

Among these known technique-, may be mentioned the one consisting in 
placing on a vehicle a bar of CCD detectors whose axis of sight is perpendicular 
to the plane of the road. In this technique, the images taken by the optical sensor 
constitute a pavement of the highway They are exploited to deduce therefrom the 
presence of a possible defect. However, such processes are relatively imprecise 
by reason, on the one hand, of the texture of the highway and. on the other hand, 
of the sensitivity to the conditions of illumination In addition, they are relatively 
slow, particularly by reason of the acquisition and processing of high-definition 
images w hich correspond to large volumes of data. 

Up to now . the problem of degradation of the highway surfacing has boen 
considered However, it will be readily understood that a similar problem ,s 
encountered as soon as the surface on which it ,s desired to detect surface defects 




has a certain texture presenting a random optical appearance. This will be the 
case for example of the detection of defects in a fabric, or more precisely in a 
web of fabric or the case of the detection of possible defects in a surfacing web 
for example made of laminated material. 

Another problem to be solved, in the case of exploiting an image for 
detecting a defect in a textured surface is that, if it is desired to analyze images 
corresponding to relatively large surfaces and if the defects are of relatively small 
dimensions, the problem of the definition of the optical sensor serving to make 
the shot is raised, in particular when the dimension of the defects may become of 
) the order of a pixel or even smaller than a pixel. In that case, the detection of a 
defect will become very difficult or highly random, particularly due to the analog- 
digital conversion that it is necessary to effect to process the image obtained. 

It is an object of the present invention to provide a process for detecting 
surface defects which allows a detection over a relatively large surface and with a 
5 relatively high speed of detection while ensuring a good quality of detection of 
the possible defects of this textured surface. 

SUMMARY OF THE INVENTION 
To that end. in accordance with the invention, the process is characterized 

by the following steps of: 

10 a) making, with the aid of an optical sensor presenting an inclination of 

sight with respect to the substantially plane textured surface and being in relative 
movement with respect to this surface, a succession of images of pans of this 
surface at successive instants, each image corresponding to a surface part of 
length L in the direction of displacement, each image being offset from the 

25 precedin one by a length 1. 1 being equal to UK with K. a whole, greater than 2; 
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b) defining sub-images corresponding to elementary portions of the surtacc 
whose length is equal to I in the direction of displacement, whereby for the length 
of portion of surface I, K sub-images of this portion are therefore available; 

c) extracting from these K consecutive sub-images N sub-images (Ii) 
5 corresponding to the same portion of the surface of length I at N successive 

instants with N included between 2 and K; 

d) applying to each of the N sub-images (Ii) the same spatial mathematical 
processing in order possibly to demonstrate a configuration of presumed defect, 
which gives a processed intermediate sub-image ( Yi); 

10 e) applying to the first processed elementary sub-image ( Yo) a 

combinatorial algorithm for detection of presumed defect in the elementary sub- 
image, whereby a spatial and temporal sub-image ST„ is obtained; 

0 iteratively repeating the application of said combinatorial algorithm to 
the spatial and temporal sub-image ST M obtained at instant ti-1 and to the 
1 5 processed elementary sub-image Yi in order to obtain a spatial and temporal sub- 
image ST, up to i = N - 1 ; and 

g) obtaining with the spatial and temporal sub-image ST N _, the image of the 
elementary portion of the textured surface with its possible defects 

It will be understood that, thanks to the invention, the determination of a 
20 defect in an elementary' portion of the textured surface results from the processing 
of sub-images corresponding to an elementary position of the surf ace occupying 
"a fixed position", these sub-images being taken at different successive instants 
Thanks to the particular processing defined hereinabove, an efficient detection of 
the presence of possible defects may be obtained, using a camera having a 
25 relatively wide field, which makes it possible rapidly to detect the possible 
defects in relatively large overall surfaces 



According to a first form of embodiment, more particularly applied to the 
detection of defects in a highway, the optical sensor is constituted by a camera 
mounted on a vehicle which, of course, moves w ith respect to the highway 

According to a second form of embodiment, the optical sensor is fixed and 
the textured surface is moved at a constant speed with respect to the optical 
sensor. This second embodiment is particularly well adapted to the detection of 
possible defects in^ fabric or in a web of laminated surfacing 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be more readily understood on reading the follow ing 
description with reference to the accompanying draw ings, in which: 

Figure I is a simplified view of the installation used for carrying out the 
process in the case of detecting defects in a highway. 

Figure 2 is a simplified view of the installation in the case of detecting 
defects on a fabric. 

Figure 3 illustrates the taking of successive images of parts of surface 

Figure 4 shows the successive sub-images of the same portion of surface 
taken at consecutive instants. 

Figure 5 illustrates the obtaining of the sub-images at different consecutiv e 
instants in the image of a part of surface. 

Figure 6 is a very schematic view of the means for processing the data 
delivered by the optical sensor: and 

Figure 7 is a block diagram illustrating the implementation of the 
combinatorial algorithm for elaborating the spatial and temporal sub-images 
DESCRIPTION OF PREFERRED EMBODIMENTS 

As has already been indicated, the process for detecting defects on the 
textured surface is based on the processing of successive images taken with the 



aid or an optical sensor presenting an inclination with respect to the surface to be 
checked, i.e. non-perpendicular thereto, and on the exploitation of the successive 
images taken. The relative displacement of the optical sensor with respect to the 
surface to be checked may be obtained either by displacement of the optical 
5 sensor with respect to the surface or by displacement of the surface with respect 

to the optical sensor. 

Referring now to the drawings, Figure 1 schematically illustrates the device 
used for detecting defects on a highway. This Figure schematically show s a 
vehicle 1 0 moving over the highway 12. A camera 14 or other like optical sensor 
1 0 is mounted on the vehicle so that its optical axis XX' makes with the surface of 
the highway an angle a different from 90 degrees. Depending on the aperture of 
the camera 14, each image taken corresponds to a length of portion of highw ay L 
This length L depends, of course, on the height H of the camera and on the 
aperture thereof. As will be explained hereinafter, the inclination and height are 
1 5 defined so that a good image of the w hole portion of highway 1 6 is obtained 

despite the different inclinations of the light rays. This Figure also schematically 
show s the processing systems 1 8 embarked on the vehicles for processing the 
signals delivered by the camera 14 in order to detect the presence of possible 
defects. 

20 Figure 2 illustrates the opposite displacement when, for example, it is 

desired to detect possible defects on a web of fabric which also constitutes a 
textured plane surface. A supporting plane surface 20. over which the web of 
fabric 22 moves, is schematically shown, this web being initially stored on a 
roller 24 and driven by a drive roller 26. A fixed camera 28 whose optical axis 

25 XX' makes an inclination a with the portion of w eb of fabric 22 moving over the 



support surface 20. takes successive images of the web of fabric. System 2^ 
processes, as will be described hereinbelow. 

This form of embodiment is particularly well suited to the detection of 
defects in a web of material presenting a textured surface and w hich is easy to 
move. This is particularly the case not only of a w eb of fabric, but also of a plank 
or piece of rough w ood or of a metal product of elongated shape 

In the follow ing description, the case of detecting defects on a highw ay 
w ill be considered, corresponding therefore to Figure I . How ever, it goes without 
saying that this description may be directly transposed to the case of detection in 
accordance w ith the form of embodiment of Figure 2. 

The successive images obtained at the different instants are used for 
forming the sequences of sub-images, each of the sequences being associated 
w ith an elementary portion of surface. A first mathematical processing* partialis or 
completely corrects the effects due to the perspective as the optical axis of the 
camera is inclined These mathematical image processings are known per so and 
are not explained here. They make it possible to give each sub-image a standard 
rectangular or trapezoidal shape less accentuated than the initial trape/oidal 
shape 

As has already been indicated, the detection of possible defects in an 
elementary portion (P) of the surface S of length I I. K is based on the 
processing of a sequence of sub-images corresponding to this portion (P) of 
surface obtained from images observed at successive instants and offset in space 
by the length I 

Figure 5 illustrates the construction of the sequence of sub-images ( I, ,) 
from the successive images allowing the obs rvation of < P.) This Figure shows in 
particular the successive positions of the camera 14 for which the images arc 



taken. An elementary portion of the surface of index j (noted (P,)) is observed in 
the sequence of images going from instant t,.K-i to instant t,. The sub-image 
corresponding to P, is extracted from each of them 

The sequence of sub-images (I M ) corresponding to the observation of an 
elementary portion (P,) of the surface forms the spatial and temporal signai which 
serves as input for the analysts step with a view to detecting possible defects on 
(P,). Figure 4 shows the sub-images (I M ) before processing thereof 

As will be explained in greater detail hereinafter, by iteratively repeating 
the mathematical processing for detection of possible defects on each of the 
successive elementary portions (P.) constituting the complete surface to be 
analyzed, the defects possibly present are thus detected in the overall surface 

Figure 5 illustrates in greater detail the "cutting" of each image into sub- 
images I,.,. The image J, taken at instant t, is cut into K sub-images I t . k <k . k varying 
trcm 0 to K-L so that each sub-image corresponds to a portion of highwav 
surface of the same length 1=L/K At instant t, u the image taken show s sub-images 
Lo to Ik i k-i At instant t„ the image shows images I tl . to l,. K k .,. 

Reciprocally, if the portion of surface P, is considered, it is present in the 
image taken at instant j in corresponding to the "lower edge of image J,'\ in the 
image taken at instant j- 1 in I, i , in the image taken at instant k-l in I lk ; 
corresponding to the "upper edge of the image J,.k*i" K sub-images I, k are thus 
obtained, k varying from 0 to K-l of the same elementary portion (P,) of length I 
of the highway at K different successive instants t,. K -i to t, 

In the following, the index of the portion of highway w ill be set aside, the 
conventions adopted for the indices making it possible to refer to the sub-imaues 
li. i varying from 0 to K-l to designate the K sub-images corresponding to a 
portion (P) cf highway 



In accordance with the principle of the invention, detection of the defects is 
effected by processing N sub-images corresponding to the same elementary 
spatial portion of highway, these sub-images being taken at N different 
consecutive instants. It will be readily understood that N must be at least equal to 
2 and that N is at the most equal to K. In a particular form of embodiment. N ^ K 
= 1 1 N and K are preferably included between 6 and 1 5. 

It will now be described how the N spatial sub-images corresponding to the 
same elementary portion of highw ay are mathematically processed at N different 
instants. 

Processing, ii, .he form of a simple temporal addition, might be effected 
directly at the level of the pixel of the sub-images obtained and convened into 
digital form. However, the inventors have demonstrated that such processing 
proved unsatisfactory to demonstrate the possible presence of defects clearlv 

Consequently, according to the invention, instead of applying a processing 
directly at the level of the pixels constituting the different sub-images, a prior 
processing is effected, making it possible to work on configurations or more 
exactly groups of pixels capable of corresponding, m a sub-image, to ;i surface 
defect A process known per se for effecting this preliminary processing step 
consists in employing an analysis gnd which is therefore the same as leaving the 
pi\ level to manipulate primitives whose nature corresponds better to the 
problem to be treated. Use of this analysis gnd per line may consist in emploving 
a markovian model which is well known per se The subsequent processing of the 
sub-images which will be described is therefore applied to the sub- images 
modified by application of the markovian model Other processings ma\ be used, 
as will be explained hereinafter 




Figure 6 illustrates the whole process of detection in simplified manner 
The analog signals delivered by the camera 14 are converted into digital signals 
by ;he converter 30. The latter is connected to a digital image processing system 
52 which employs the process of correction of the images and of "cutting" the 

5 images into sub-images. System 34 brings into register the digital sub-images 
corresponding to the same elementary portion of surface and memon/es them in 
>t\ System 38 effects spatial processing of each sub-image for example b> 
application of a markovian model. Finally, system 40 effects the spatial and 
temporal processing of the sub-images 42 w hich w ill be described hereinafter 

10 with reference to Figure 7. This latter system makes it possible to obtain the 
image of each elementary portion of surface w ith its possible defects 

Referring now to Figure 7, the processing of the different sub-images 
obtained by the method described previously will now be described in greater 
detail This Figure explains the spatial and temporal processing svstcm 40 of 

15 Figure 6. In Figure 7, the reference Y, designates the spatial sub-image obtained 
at instant t, and to which the extraction grid has been applied References I 
indicate the steps of markovian segmentation applied to the spatial-temporal 
images. References S T' t designate initial spatial-temporal sub-images and S I . 
processed spatial-temporal sub-images The first spatial-temporal image ST is in 

20 fact identical to the spatial image Y 0 By markovian segmentation I.,, the spatial- 
temporal sub-image ST,» is obtained In the following step referenced 50. the 
second spatial sub-unage Y ( is combined with the first spatial-temporal image 
ST ( , with the aid of a combinatorial algorithm which will be defined hereinafter 
By markovian segmentation, the spatial-temporal image of row I is obtained at 

25 step 52 
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More generally, it will be understood that, in order to obtain the spatial- 
temporal sub-image of row i, one starts from the spatial-temporal sub-image of 
row i - 1 which is combined with the spatial observ ation of row i. this giving the 
initial spatial-temporal sub-image then, by markovian segmentation, the definitive 
spatial-temporal image of row i is obtained. It will be understood that this 
operation of application of the combinatorial algorithm is carried out repeatedly 
up to i = N - I The spatial-temporal image of row N - i to which the markovian 
segmentation has been applied, furnishes a sub-image on which the defect clearly 
appears, if such a defect is effectively present in the elementary portion of surface 
in question. 

A preferred form of embodiment of the combinatorial algorithm w ill now 
be described in greater detail, which makes it possible to obtain, from the spatial 
sub-image Yi and the spatial-temporal sub-image ST,.,, the spatial-temporal sub- 
image ST,. 

The spatial sites of Y, are all carried over in ST',. 

The sites of ST,., having for descriptor I in L,., are projected in ST',. For 
any site s projected from ST, in accordance with the following conditions: 

- if there is located near s a site s' coming from Y, and such that the centres 
of s and s" are 8-adjacent. the two sites are transformed into a single resultant site 
^resultant- Two cases are distinguished: 

- s and s' are not perpendicular with respect to each other a fusion of the 
two sites is made, and the characteristics of the resultant site are as follows: 

. position: the position of s^,^, is that of s' : fx rc<ulUin! , y roM1)lam )=(x,,y s .) 
orientation, the orientation e reMlltint is that of the site s or s' which attains 
max(st I . I (s).y,(s)) if < si st,.,(s) = y,(s ). 9 resuluim = 8 S , 

amplitude: st',( s^i^n, ) = maxist-i s).y,(s')) - 1 r| .min(st 1 .|(s),y,(s')). 
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- s and s' are perpendicular with respect to each other: s is eliminated, 
hence s,.. 

if there is no site s' coming from Y, and such that the centres of s and s 
are 8-adjacent, then s is conserved as such: s^ium, = s. 

The markovian segmentation L, obtained from ST*, furnishes important 
indications by distinguishing in ST', the sites which may be considered as 
significant from those which are not. The field of the descriptors L, is therefore 
used for re-assessing the amplitude of the sites of ST', , which leads to the final 
spatial-temporal observation ST,: 

For any site s of ST',: 

- if s comes from Y, (spatial origin), its amplitude remains unchanged: st.(s) 
■= st\(s). 

- if s comes from ST,., (temporal origin), the segmentation L, intervenes 

- if l,(s) - T, the amplitude of s is maintained: st,(s> - st',(s). 

- if 1,(s) = "0", the amplitude of s is reduced: st,(s) = 1/n. st',(s). 

It w ill be understood that the temporal evolution of st is thus obtained 
during increase or decrease of the amplitude of these sites. The increase of the 
amplitude of the significant sites comes from the calculation of st'.fs,^,,,,.,,,,), during 
the phase of fusion of two sites not perpendicular to each other The formula 
adopted represents a simple manner of calculating the amplitude of the new site 
(conservation of the maximum amplitude and addition of a fraction of the 
minimum amplitude), but other modes of calculation of st',( senium) fr<> m S I ,.i(s) 
and y, may be imagined Decrease of the amplitude of the non-significant sites is 
obtained during calculation of ST,, in the case of s not being conserved in the 
over-segmentation (l,(sK'0'). 




12 



In the foregoing description, instead of using the sub-images at the level of 
the pixel to elaborate the spatial-temporal sub-images, a technique of markovian 
segmentation has been carried out. However, it goes without saying that this 
process does not limit the invention. 
5 Another process consists in carrying out a process of extraction of related 

components, known per se, which makes it possible to apply the algorithm to 
configurations of larger dimensions w hich improves the detection of the possible 
defects. 

In the case of carrying out the process of extraction of related components, 
10 the combinatorial algorithm is applied similarly to what has been described in 
connection with Figure 7. 

It will be understood that, whatever the variant of the process, the latter 
consists in processing N sub-images corresponding to the same elementary 
portion of surface to be checked, the sub-images having been taken at N 
1 5 consecutive instants. 

The experiments carried out show that the repeated process applied to 
these N sub-images makes it possible to obtain a good quality of detection of the 
possible defects in the elementary portion of textured surface in question. 

In particular, it is observed that this repeated processing directed on N sub- 
20 images makes it possible to be free from the unknown factors of analog-digital 
conversion when the possible defects to be detected have a size comparable to 
the size of the zone covered by a pixel in the image taken. 
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The claims defining the invention are as follows- 

I Process for detecting surface defects in a substantially plane textured 
surface, 

wherein it comprises the following steps of: 

a) making, with the aid of an optical sensor presenting an inclination of 
sight with respect to the substantially plane textured surface and being in relative 
movement with respect to this surface, a succession of images of parts of this 
surface at successive instants, each image corresponding to a surface pan of 
length L in the direction of displacement, each image being offset from the 
preceding one by a length 1, 1 being equal to L/K with K, a whole, greater than 2; 

b) defining sub-images corresponding to elementary portions of the surface 
whose length is equal to I in the direction of displacement, whereby for the length 
of portion of surface 1, K sub-images of this portion are available; 

c) extracting from these K consecutive sub-images N sub-images (Ii) 
corresponding to the same portion of the surface of length I at N successive 
instants with N included between 2 and K; 

d) applying to each of the N sub-images (Ii) the same spatial mathematical 
processing in order possibly to demonstrate a configuration of presumed defect, 
which gives a processed intermediate sub-image (Yi); 

e) applying to the first processed elementary sub-image (Yo) a 
combinatorial algorithm for detection of presumed defect in the elementary sub- 
image, whereby a spatial and temporal sub-image ST„ is obtained; 

0 iteratively repeating the application of said combinatorial algorithm to 
the spatial and temporal sub-image ST,., obtained at instant ti-l and to the 
processed elementary sub-image Yi in order to obtain a spatial and temporal sub- 
image ST, up to i - N - I ; and 
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g) obtaining with the spatial and temporal sub-image ST N ., the image of the 
elementary portion of the textured surface with its possible defects 

2. The process of Claim 1 , wherein, before step d), there is applied to each 
sub-image a processing for at least partial correction of the effects of perspective 

5 due to the inclination of the optical sensor with respect to the textured surface 

3. The process of Claim 2, wherein said spatial mathematical process of step 
d) consists in applying to said elementary image a markovian model with regular 
or irregular grid. 

4. The process of Claim 2, wherein said spatial mathematical processing of 
10 step d) consists in effecting an extraction of the related components from the 

pixels of the sub-image. 

5. The process of any one of Claims 1 to 4, w herein said optical sensor is a 
camera mounted on a vehicle and the textured surface is the surface of a highw ay 

6. The process of any one of Claims I to 4, w herein said optical sensor is 
15 fixed and the textured surface moves linearly w ith respect to the optical sensor 

7. The process of Claim 6, wherein the surface is a web of fabric 

8. The process of Claim 6. wherein said surface is a piece of rough w ood 
9 The process of Claim 6. wherein said surface is that of a long met al 
product. 
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PROCESS FOR DETECTING SURFACE DEFECTS ON A TEXTURED SURFACE 



ABSTRACT OF THE DISCLOSURE 

The invention concerns a process for detecting defects in a textured suface, 
particularly on a highway. The process consists in displacing with respect to the 
surface a camera presenting an inclination and in processing by processing 
systems the successive images taken by the camera. A mathematical processing is 
effected on sub-images, corresponding to the same spatial portion of the surface, 
taken at different consecutive instants. 
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